3D Hand Pose Estimation in Point Cloud Using 3D Convolutional Neural Network on Egocentric Datasets

نویسندگان

چکیده

3D hand pose estimation from egocentric vision is an important study in the construction of assistance systems and modeling robot robotics. In this paper, we propose a complete method for estimating posefrom complex scene data obtained sensor. which simple yet highly efficient pre-processing step segmentation. process, used Hand PointNet (HPN), V2V-PoseNet(V2V), Point-to-Point Regression (PtoP) finetuning to estimate collected sensor, such as CVRA, FPHA (First-Person Action) datasets. HPN, V2V, PtoP are thedeep networks/Convolutional Neural Networks (CNNs) that uses point cloud hand. We evaluate results using preprocessing do not use see effectiveness proposed method. The show distance error increased many times compared estimates on datasets obstructed (the surveillance cameras, viewed top view, front sides view) MSRA, NYU, ICVL quantified, analyzed, shown CVAR dataset projected color image dataset.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hand3D: Hand Pose Estimation using 3D Neural Network

We propose a novel 3D neural network architecture for 3D hand pose estimation from a single depth image. Different from previous works that mostly run on 2D depth image domain and require intermediate or post process to bring in the supervision from 3D space, we convert the depth map to a 3D volumetric representation, and feed it into a 3D convolutional neural network(CNN) to directly produce t...

متن کامل

3D Hand Pose Estimation with Neural Networks

We propose the design of a real-time system to recognize and interpret hand gestures. The acquisition devices are low cost 3D sensors. 3D hand pose will be segmented, characterized and track using growing neural gas (GNG) structure. The capacity of the system to obtain information with a high degree of freedom allows the encoding of many gestures and a very accurate motion capture. The use of h...

متن کامل

Worldwide Pose Estimation Using 3D Point Clouds

We address the problem of determining where a photo was taken by estimating a full 6-DOF-plus-intrincs camera pose with respect to a large geo-registered 3D point cloud, bringing together research on image localization, landmark recognition, and 3D pose estimation. Our method scales to datasets with hundreds of thousands of images and tens of millions of 3D points through the use of two new tec...

متن کامل

3D Hand Pose Detection in Egocentric RGB-D Images

We focus on the task of everyday hand pose estimation from egocentric viewpoints. For this task, we show that depth sensors are particularly informative for extracting near-field interactions of the camera wearer with his/her environment. Despite the recent advances in full-body pose estimation using Kinect-like sensors, reliable monocular hand pose estimation in RGB-D images is still an unsolv...

متن کامل

3D Point Cloud Classification and Segmentation using 3D Modified Fisher Vector Representation for Convolutional Neural Networks

The point cloud is gaining prominence as a method for representing 3D shapes, but its irregular format poses a challenge for deep learning methods. The common solution of transforming the data into a 3D voxel grid introduces its own challenges, mainly large memory size. In this paper we propose a novel 3D point cloud representation called 3D Modified Fisher Vectors (3DmFV). Our representation i...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal on Information Technologies & Communications

سال: 2021

ISSN: ['1859-3534']

DOI: https://doi.org/10.32913/mic-ict-research.v2020.n2.936